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Description 

[0001] The present invention relates to identifying video and/or audio material. The invention also relates to a 
method of. and apparatus for, identifying video and/or audio material and/or data. 

5 [0002] The following discussion refers to video for convenience. The invention is not limited to video: it may be 
applied to audio. It may be applied to data other than video and audio, it may be applied to any one or more of video, 
audio and data. "Material" as used herein refers to any one or more of video, audio and other data. 
[0003] It is known to identify the ownership of video material by applying a "watermark" to the video signal. A water- 
mark may also, or alternatively identify a distributor of the material. A watermark is a coded signal, which is combined 

10 with the video signal in such a way that the coded signal is invisible or substantially invisible in the displayed image. The 
coded signal Is detectable in the video signal: It Is used for detecting Infringement of copyright for example. 
[0004] According to one aspect of the present invention, there is provided a method of identifying material compris- 
ing the step of inserting an identifying code into the material as a watermark, which code directly or indirectly identifies 
the material. 

IS [0005] According to another aspect of the invention, there is provided apparatus comprising a code generator for 
generating a code which directly or indirectly identifies material, and a watermark generator for generating, from the 
code, a watermark and for combining the watermark with the material. 

[0006] Thus instead of identifying the ownership or distributor, the present invention uses the watermark to directly 
or indirectly identify the material. This allows other metadata relating to the material to be directly or indirectly linked to 
20 the material. Examples of such metadata include technical metadata and descriptive metadata. An example of descrip- 
tive metadata is the title of the material. In the case of video material, an example of technk:al metadata is data con- 
cerning camera aspect ratio. The metadata may be stored in a database, separate from the recording medium carrying 
the material, and the identifying code in the watemiark links the material to the database. 

[0007] By providing the identifying code In the watemiark in the signal, the material retains its identification through- 
25 out the production and distribution chain following the provision of the code. This also avoids the necessity of a separate 
channel such as a separate tape track for the identifying code. That makes easier subsequent material processing with 
retention of the identifying code in association with the material. 

[0008] In one embodiment of the invention, the material is recorded on an example of a recording medium and the 
identrfying code is a code identifying the example of the recording medium. The identifying code may be, for example, 
30 a serial number. By way illustration, CDs may be given serial numbers, each CD being an example of a recording 
medium. The Identifying code may be used to refer to a UMID. a unique material identifier thus indirectly identifying the 
material. 

[0009] In embodiments of the invention, the code is inserted into the signal or recorded with the signal in addition 
to being in the watermark. For example, the code may be in user bits of vertical interval time code and/or linear time 
35 code of video material. 

[0010] In another embodiment, the code is a UMID thus directly identifying the material. UMIDs may be used to 

identify video, audio and data material. 

[001 1] A \JM\D allows unique linking of the material metadata stored in a database. 

[001 2] In an embodiment in which the code is a UMID, the instance number of the UMID is used to provide in a plu- 
40 rality of copies of a piece of material respective UMIDs and thus watermarks which are unique to individual users or 
groups of users in addition to identifying the material. 

[0013] For a better understanding of the present invention, reference will now be made by way of example to the 
accompanying drawings in which: 

45 Figure 1 is a schematic diagram of an illustrative video material processing system embodying the present inven- 

tion; 

Rgure 2 illustrates a basic and extended UMID; 
Rgure a Illustrates a reduced data structure; 

Rgure 4 is a schematic block diagram of an illustrative spatial domain watermarking system; 
so Rgure 5 is a schematic block diagram of an illustrative frequency domain watermarking system; 

Rgure 6 illustrates a data structure of a metadata base: 

Rgures 7 to 9 illustrate the use of Linear Time Codes; 

Rgure 1 0 is a block diagram of an illustrative watermark inserter; 

Rgure 11 is a block diagram of an illustrative UMID detector; and 
55 Rgure 1 2 is a block of a system for removing a watermari< from a watermarked image. 

[001 4] The following description illustrates the invention by way of reference to identifying video material. However, 
the invention is not limited to video material. 
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Overview 

[001 5) Referring to Rgure 1 , UMIDs are generated by a generator 701 . UMIDs are described in the section UMIDs 
belovA A UMID universally uniquely identifies video and/or audio, and/or other data material as will be described below. 
5 Video material is generated by a source 703. The source may be any video source known in the art, including a camera, 
a VTR, a disc recorder/reproducer, and a video server amongst other sources. In accordance with an ennbodiment of 
the present invention, a basic UMID is Inserted as a watemnark. by a watermark Inserter 705, into every frame of the 
video material. Examples of Inserters 705 are described In the section Watermarking below. 

[O016] The watennarked video material Is utilised in a utiliser 71 7. The utillser 71 7 may be a transmission, or other 
10 distribution, chain, a video processor for example an editor, or a video store amongst other possibilities. 

[0017] One or more watemnark detectors 707 Is/are provided for detecting the watermark In the material. The 
detectors may be provided in the utiliser 717, or in the transmission or distribution chain, or elsewhere in a video pro- 
duction and distribution system. 

[O018] The UMID in the material uniquely links the material to metadata in a database processor 709. Metadata 
15 which may be included in the database is described in the section Metadata below. 

[0019] By detecting the watermark and extracting therefrom the UMID using the detector 709. the metadata rele- 
vant to the material may be accessed. Metadata may be provided in the database by means symbolically shown at 71 1 . 
Such means may be a keyboard and/or one or.more communication links via which metadata Is provided from one or 
more sources (not shown). 

20. [0020] Using the bask; UMID allows access to the metadata relating to the material. By putting the UMID in the 
video material as a watermark the need for a separate channel, such as a separate track in a tape, is avoided. If the 
watermark is robust, then it will survive processing e.g. editing or special effects, and/or transmission and/or distribution 
and so maintain the link with the metadata. 

[0021] An embodiment of the Invention uses an extended UM ID. An extended UMID allows the Identification of the 
25 owner of the material by virtue of the Country, Organisation and User bytes. Also, an extended UMID has a Time/Date 
field which may include video field time codes. Thus an extended UMID not only may be provided in every frame but 
also may identify uniquely every frame by time codes and may identify ownership of every frame. Video material Is often 
produced t>y combining dips whk;h may have different owners. Thus the watermarks of this embodiment of the inven- 
tion allow identification of ownership to the accuracy of one frame. Also the need for a separate channel is avoided and 
30 links to the associated metadata are provided by the UMIDs. Details of ownership are preferably provided in the data- 
base of processor 709. 

Finaerprintina 

35 [0022] A basb UMID has an Instance Number field which Is used to distinguish different instances of the same 
material. For example an original video dip is a first instance of the material. A copy of it is a second instance. The 
instance number may represent different representations of the same material. If say the first instance is analogue then 
a digital compressed version of that is another instance. 

[0023] In accordance with an embodiment of the invention, the instance number is used to identify authorised users 

4o of the video material. For example, copies of original video material owned by one organisation may be made available 
to other organisations for distribution through different distribution channels or in different markets or in different ver- 
sions. Each organisation is identified by a code entered into the instance number field of the basic UMID. 
[0024] This requires a method of generating codes which are different from normal instance numbers. (The SMPTE 
standard, current at the time of writing this patent application, for generating instance numbers does not cover gener- 

45 ating the codes of this embodiment of the invention.) To avoid ambiguity, a central registry of Codes and the organisa- 
tions to which they refer may be provided by a database processor refen-ed to as Registry 715. An organisation 
requiring a code applies to the registry which allocates a code. Alternatively, rules for generating the codes automati- 
cally by the organisations may be provided. As another alternative, the codes may be automatically generated by the 
organisations using random number generators to minimise but not necessarily eliminate ambiguity. Preferably codes 

so generated automatically would be registered with the registry 715 after generation. 

[0025] Thus the UMID as a watenmark may be used to identify different authorised users of video material. This is 
done to frame accuracy and if done using an extended UMID also identifies the owner(s) of the video material. 
[0026] In addition to providing the identifying code, preferably a UMID, In a watermark, the code may also be in the 
signal. For example it may be in the vertical blanking interval. It may be in the user bits of Linear Time Code (LTC) of a 

55 tape and/or in the user bits of the Vertical Interval Time Code (VTIC). The Insertion into LTC is described below in the 
section of that name. 

[0027] Providing the identifying code in VfTC or LTC may be advantageous when processing the video material 
allowing the identifying code to be more easily and simply accessed than by decoding it from the watermark. 



3 
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UMIDs-Raures 2 and 3. 
UMIPs 

5 [O028J A UMID is described in SMPTE Journal, March 2000. Such a UMID is refen-ed to herein as the UMID of the 
SMPTE standard. Referring to Figure 2, an extended UMID is shown. It comprises a first set of 32 bytes of basic UMID 
and a second set of 32 bytes of signature metadata. 

[O029] TTie first set of 32 bytes is the basic UIVIID. The components are; 

10 •A 12-byte Universal Label to Identify this as a SMPTE UMID. It defines the type of material which the UMID iden- 
tifies and also defines the methods by which the globally unique Material and locally unique Instance numbers are 

created. 

•A 1 -byte length value to define the length of the remaining part of the UMID. 

•A 3-byte Instance number which is used to distinguish between different 'instances' of material with the same 
15 Material number. 

•A 16-byte Material number which is used to identify each clip. Each Material number is the same for related 
instances of the same material. 

[O03O] The second set of 32 bytes of the signature metadata as a set of packed metadata items used to create an 
20 extended UMID. The extended UMID comprises .the basic UMID followed immediately by signature metadata which 

comprises: 

•An 8-byte time/date code identifying the time and date of the Content Unit creation. 
•A 12-byte value which d^ines the spatial co-ordinates at the time of Content Unit creation. 
25 •3 groups of 4-byte codes which register the country, organisation and user codes 

[0031] Each component of the basic and extended UMIDs will now be defined in turn. 

The 12-byte Universal Label 

30 

[0032] The first 12 bytes of the UMID provide identification of the UMID by the registered string value defined in 
table 1 . 



Byte No. 


Description 


Value (hex) 


1 


Object Identifier 


G6h 


2 


Label size 


OCh 



45 



SO 



55 



4 
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-3 


Designation: ISO 


2Bh 


4 


Designation: SMPTE 


34h 


5 


Registry: Dictionaries 


Olh 


6 


Registry: Metadata Dictionaries 


Olh 


7 


Standard: Dictionary Number 


Olh 


S 


Version number 


Olh 


9 


Class: Identification and location 


Olh 


10 


Sub-clasis: Globally Unique Identifiers 


Olh 


11 


Type: UMID (Picture, Audio, Data, Group) 


01,02,03,04h 


12 


Type: Number creation method 


XXh 



Table 1: Specification of the UMID Universal Label 



25 

[0033] The hex values In table 1 may be changed: the values given are exannples. Also the bytes 1-12 may have 
designations other than those shown by way of example in the table. Referring to the Table 1, In the example shown 
byte 4 indicates that bytes 5-12 relate to a data format agreed by SMPTE. Byte 5 indicates that bytes 6 to 1 0 relate to 
30 "dictionary" data. Byte 6 indicates that such data Is "metadata" defined by bytes 7 to 1 0. Byte 7 Indicates the part of the 
dictionary containing metadata defined by bytes 9 and 10. Byte 10 indicates the version of the dictionary. Byte 9 Indi- 
cates the class of data and Byte 1 0 indicates a particular item in the dass. 

[0034] In the present embodiment bytes 1 to 10 have fixed preassigned values. Byte 1 1 is variable. Thus refemng 
to Figure 3, and to Table 1 above. It will be noted that the bytes 1 to 1 0 of the label of the UMID are fixed. Therefore they 
35 may be replaced by a 1 byte Type* code T representing the bytes 1 to 1 0. The type code T is followed Ijy a length code 
L. That is followed by 2 bytes, one of which is byte 1 1 of Table 1 and the other of which is byte 1 2 of Table 1 , an instance 
number (3 bytes) and a material number (1 6 bytes). Optionally the material number may be followed by the signature 
metadata of the extended UMID and/or other metadata. 

[0035] The UMID type (byte 1 1 ) has 4 separate values to identify each of 4 different data types as follows: 

AO 

•01 h' = UMID for Picture material 
'02h' = UMID for Audio material 
. '03h' = UMID for Data material 

'04h> UMID for Group material (i.e. a combination of related essence). 

45 

[0036] The last {12th) byte of the 12 byte label identifies the methods by which the material and instance numbers 
are created. This byte is divided into top and bottom nibbles where the top nibble defines the method of Material number 
creation and the bottom nibble defines the method of Instance number creation. 

so Length 

[0037] The Length is a 1-byte number with the value '13h' for basic UMIDs and 'SSh' for extended UMIDs. 
Instance Number 

55 

[0038] The Instance number of the SMPTE standard is a unique 3-t)yte number which is created by one of several 
means defined by the SMPTE standard. It provides a link between a particular 'instance' of a clip and externally asso- 
ciated metadata. Without this instance number, all material could be linJced to any instance of the material and its asso- 



5 
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ciated metadata. 

£0039] . The creation of a new clip requires the creation of a new Material number together with a zero Instance 
number. Therefore, a non-zero Instance number indicates that the associated clip is not the source material. An 
Instance number is prinnarily used to identify associated metadata related to any particular instance of a clip. 
5 [O04O] In accordance with an embodiment of the present invention, the instance number of the SMPTE standard is 
nnodrfied. It is used to identify authorised users of the material. Thus a code is used as a "fingerprint". The code be 
generated as described above In the section "Fingerprinting'. 

Material Number 

10 

[0041] The 1 6-byte Material number is a non-zero number created by one of several means identified in the stand- 
ard. The number is dependent on a 6-byte registered port ID number, time and a random number generator. 

Signature Metadata 

15 

[0042] Any component from the signature metadata may be null-filled where no meaningful value can be entered. 
Any null-filled component is wholly null-filled to cleariy indicate a downstream decoder that the component is not valid. 

The Time-Date Format 

20 

. [0043] The date-time fornnat is 8 bytes where the first 4 bytes are a UTC (Universal Time Code) based time com- 
ponent. The time is defined either by an AES3 32-bit audio sample dock or SMPTE 12M depending on the essence 

type. 

[0044] The second 4 bytes define the date based on the Modified Julian Data (MJO) as defined in SMPTE 309M. 
25 This counts up to 999,999 days after midnight on the 1 7th November 1 858 and allows dates to the year 4597. 

The Spatial Co-ordinate Format 

[0045] The spatial co-ordinate value consists of three components defined as follows: 

30 

•Altitude: 8 decimal numbers specifying up to 99,999,999 metres. 

•Longitude: 8 decimal numbers specifying East/West 180.00000 degrees (5 decimal places active). 
•Latitude: 8 decimal numbers specifying North/South 90,00000 degrees (5 decimal places active). 

35 [0046] The Altitude value is expressed as a value in metres from the centre of the earth thus allowing altitudes 
below the sea level. 

[0047] It should be noted that although spatial co-ordinates are static for most clips, this is not true for all cases. 
Material captured from a moving source such as a camera mounted on a vehicle may show changing spatial co-ordi- 
nate values. 

40 

Country Code 

[0048] The Country code is an abbreviated 4-t>yte alpha-numeric string according to the set defined in ISO 31 66. 
Countries which are not registered can obtain a registered alpha-numeric string from the SMPTE Registration Authority. 

45 

Organisation Code 

[0049] The Organisation code is an abbreviated 4-byte alpha-numeric string registered with SMPTE. Organisation 
codes have meaning orily in relation to their registered Country code so that Organisation codes can have the same 
50 value in different countries. 

User Code 

[0050] The User code is a 4-byte alpha-numeric string assigned locally by each organisation and is not globally reg- 
55 istered. User codes are defined in relation to their registered Organisation and Country codes so that User codes may 
have the same value in different organisations and countries. 



6 
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Freelance Operators 

[0051] Freelance operators may use their country of domicile for the country code and use the Organisation and 

User codes concatenated to e.g. an 8 byte code which can be registered with SMPTE. These freelance codes may start 
with the symbol (ISO 8859 character number 7Eh) and followed by a registered 7 digit alphanumeric string. 
[0052] It will be noted from the foregoing discussion that a UMID may be used to Identify not only video material, 
but also audio material, data material, and a group of material. 

Watermarkina-FiQures 4 and 5 

[0053] Digital watermarking allows a code to be embedded in a digital work. The digital watermark may be used in 

conjunction with other deterrents such as encryption. 

[0054] In embodiments of the present Invention, the watermark undetectable. It is preferably unalterable and non- 
removable by unauthorised individuals. The watermark preferably does not adversely degrade the underlying work in a 
manner that is readily perceptible. In addition, the watermark is readily discernible by authorised individuals. 
;;[0055] The watermark may be placed in, for example, a header or label of a digital work, or the watemrrark may be 
^embedded within the data fields of the digital work itself. Preferably, the watermark occurs many times within a work. 
For example It may be present in every frame of a digital video work. Alternatively, the watermark may be placed directly 
onto the media which carries the digital work. 

[0056] The watermark may be robust such that it may not be removed or degraded by Individuals seeking to make 
-unauthorised copies. Unauthorised attempts to remove the robust watermark should result In severe degradation of the 
data, rendering the data useless. Situations where the data contains much redundant information, such as In video, 
may render the robust watermark susceptible to attack by, for example, frame dropping or the like. Hence, the robust 
watenmark should preferably withstand such attacks and may, for example, change from frame to frame and may utilise 
any error correction/recovery techniques which are applied to data. 

[0057] Alternatively, the watermark may be fragile such that it is damaged should an unauthorised copy be made. 
That enables detection of the unauthorised copy. 

[0058] However, the watemnark should also preferably be reversible and removable by the owner, if required. 
Removal may be particularly useful during, for example, a post-production stage to reduce any cumulative effects of the 
watennark on the underlying work. Also, where information from different sources are edited together it may be desired 
that a different watermark is applied to the edited product. 

[0059] End-user equipment may be configured to recognise the watennark such that It will not allow copying of pro- 
tected works. Alternatively, the equipment may be configured such that it will only play works originating from a partic- 
ular owner, distributed through a particular distributor or where the work contains a particular authorisation code. 
[0060] The watermark may be extracted by comparing watermarked with non-watermari<ed data and its authentic- 
ity established. 

[0061] . Three technk^ues for Imperceptibly embedding a watermaric within the data fields of a digital work will now 
be described In more detail. The first is to embed the watermark In the spatial domain, the second is to embed the 
watermark In the frequency domain, and the thind is an example of the second. All of these embedding processes are 
such that they do not result In a significant degradation of the data being watermarked. 

Spatial Domain Watermarks 

[0062] The process, in overview, involves altering predetermined data bits with the bits of a watermark to produce 
watermarked data. The existence of watermark may be detennined by perfomning the reverse operation on the water- 
marked data. 

[0063] One approach is to embed a watermark by substituting insignificant bits of pseudo-randomly selected data 
with bits representing the watermark. However, these watermarks are susceptible to destruction by processing the least 
significant bits of the data. Another is to insert geometric patterns into the data which represent a watermai'k. However, 
these watermarks are susceptible destruction by geometric processing of the data. A further approach is to embed a 
watemnark In a manner which resembles quantisation noise as described with reference to Figure 4 below and more 
fully described in artteles titled "Embedding Secret Information into a Dithered Multi-Level Image" by K Tanaka et al, 
IEEE Mifitary Communications Conference pages 216-220, 1990 and "Video Steganography" by K Mitsui, IMA Intellec- 
tual Property Proceedings, volume 1, pages 1 87-296, 1994. However, these watermarks are susceptible destruction by 
signal processing, particularly by requantisation of the data. 

[0064] Refening now to Rgure 4, a source 650 produces a digital data signal 652, such as digital video. A water- 
mark inserter 700 is couple to the source 650 and receives the digital data signal 652. The watermark inserter 700 
applies the watermark 663 by applying the watemiark to the digital data signal 652 in a manner that resemble requan- 
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tisation noise to produce watermarked data 705. A storage device 670 is coupled to the watermark inserter 700 and 
stores the watermarked data 705. 

[0065] A yet further approach is to randomly select n pairs oMmage points (aj, bj) and increase the brightness of aj 
by one while decreasing the brightness of bj by one. Assuming certain statistical properties of the image are satisfied, 
the sum of the differences of the n pairs of points will be 2n. 

[0066] Alternatively where the data signal comprises at least two components (for example [Y. UV] according to 
MPEG, PAL or NTSC), the watermark may be embedded by assigning values to these components which, in combina- 
tion, do not usually occur. Also, where a watermark is to be embedded in, for example, video data containing two image 
fields, a positive watermark may be placed into the first field and a negative watermark into the second field. When 
watemriarked image fields are played there is a masking effect due to the Interlacing of the fields and the visual percep- 
tion of the watemiark is significantly reduced. 

Frequency Domain Watermarl<s 

[0067] The process, in overview, involves obtaining a frequency spectral Image of the data to which the watermark 
is to be applied. The watermark is embedded into predetermined components of the frequency spectral innage. There- 
after, the watermarked frequency spectral image is subjected to an inverse transform to produce watermarked data. 
The watermark may be extracted by performing the reverse operation on the watermarked data. 
[0068] One approach is to partition the data into blocks and compute the Discrete Cosine Transform (DCT) of each 
of these blocks. Thereafter, the predetermined frequency coefficients of the blocks may be adjusted. A pseudo random 
subset of blocks may be chosen and In each such block coefficients of predetermined subset of frequencies adjusted 
such that their relative values encode a data bit. The variance in the relative values and the selection of the predeter- 
mined subset of frequencies should be such that the watermark Is not perceptible. However, this watennari< may be 
sensitive to damage by noise or further processing. 

[0069] Alternatively, the watermark may be encoded by adjusting every frequency coefficient by a smaller amount 
as described with reference to Figure 5 below and more fully described in European Patent Application 0 766 468, NEC 
Corporation. This has the advantage of making the watermark less sensithre to damage, but increases overall noise lev- 
els. 

[0070] Refen-ing now to Figure 5, a source 650 produces a digital data signal 652. such as digital video. A fre- 
quency transformer 655 is coupled to the source 650 and receives the digital data signal 652, The frequency trans- 
fomier 655 transforms the digital data signal 652 into frequency spectral data 657 using, for example. Discrete Cosine 
Transforms or Fast Fourier Transform techniques. A watermark inserter 660 is couple to the frequency transformer and 
receives the frequency spectral data 657. The watermark inserter applies the watermark 663 by adjusting each coeffi- 
cient of the frequency spectral data 657 to produce watermarked frequency spectral data 663. An inverse frequency 
transformer 665 is coupled to the watemriark inserter 660 and receives the watermarked frequency spectnal data 663. 
The inverse frequency transfomner 665 converts the watemiarked frequency spectral data 663 into watermarked data 
667. A storage device 670 is coupled to the inverse frequency transformer 665 and stores the watermarked data 667. 
[0071] A further approach is to Increase the changes to coefficients In particular frequencies by exploiting the exist- 
ence of so-called masking phenomena in the human visual and auditory systems. Masking occurs when certain regions 
of data are occluded by perceptually more prominent regions elsewhere in the data. IHowever, these regions need to be 
identified prior to inserting the watermark which increases the embedding complexity. 

[0072] A yet further approach is to compress the digital data and embed the watermark into the x and y co-ordi- 
nates of motion vectors of the compressed data. This has the advantage of the watemnark being embedded after com- 
pression and, hence, is more robust to processing. 

[0073] A cunentty preferred embodiment of a watermark Inserter is shown in Figure 1 0. and a currently preferred 
UMID detector is shown in Figure 11. 

[0074] Figure 1 0 illustrates the watermark embedder 120. The watermark embedder 1 20 comprises a pseudo-ran- 
dom sequence generator 220. an error correction coding generator 200, a wavelet transformer 21 0, an inverse wavelet 
transformer 250, a first combiner 230 and second combiner 240. 

[0075] . , The error correction coding generator 200 receives a UMID 1 75 and outputs an error correction coded UMID 
205. to the first combiner 230. The pseudo-random sequence generator 220 outputs a pseudo-random sequence 225 
to the combiner 230. The first combiner 230 receh/es the error con-ection coded UMID 205 from the error connection 
coding generator 200. the pseudo-random sequence 225 from the pseudo-random sequence generator 220 and out- 
puts a watermari< comprising a sequence of bits Wi to the second combiner 240. The wavelet transformer 21 0 receives 
a video image 115 from the source 110 and outputs a wavelet image X'i (comprising wavelet coefficients X'i where X'i 
is the ith wavelet coefficient of the transformed image to whteh bit Wi of the watermark Is applied) to the second com- 
biner 240. The second combiner 240 receives the watemnark Wi from the first combiner 230, the wavelet Image Xi from 
the wavelet transformer 210, a watermark strength coefficient a from the strength adapter 180 and outputs a water- 
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marked wavelet image X'i = Xi+aWi where X'i is the hh watermarked coefficient. The watermarked wavelet image Xi 
is applied to the inverse wavelet transformer 250. The inverse wavelet transfonmer 250 receives the watenmarked wave- 
let image Xi and outputs a watermarked image 125. 

[O076] The operation of the embedder 120 will now be described in more detail. In overview, a UMID 175 associ- 
5 ated with an video image 1 15 is processed to provide error correction coded UiVilD 205 and thereafter combined with 
the pseudo-random sequence 225 to produce a spectrum signal spread spectrum signal which is used as the water- 
mark Wi. A video image 1 15 is transformed into a wavelet image Xi and thereafter the watermark 235 is applied in com- 
biner240 to produce the watermarked wavelet image 245. The watermarked wavelet image 245 is then transformed to 
produce a watermarked image 1 25. 
w [0077] The use of error correction coding to produce an enror correction coded UMID 205 is advantageous since it 
allows the UMID 1 75 to be reconstructed more readily should some information be lost. This provides a degree of 
robustness to future processing or attacks against the watermark. The use of a pseudo-random sequence 225 to gen- 
erate a spread spectrum signal for use as a watermark 235 is advantageous since it allows the error correction coded 
UMID 205 to be spread across a larger number of bits. Also, it allows the watermark Wi to be more effectively hidden. 
15 Applying the watermark Wi to a wavelet image 215 is advantageous since this reduces the perceptibility of the water- 
mark. Furthermore, the strength a of the watermark 235 may be adjusted to ensure that the watermark 235 is not per- 
ceptible. V. 

[0078] The operation of a watermark decoder 140 will now be explained in more detail with reference to Figure 11. 
The watermark-decoder 140 receives the watermarked image 125 and outputs the UMID 175. The watermark decoder 
140 comprises:a wavelet transfonmer 310, a pseudo-random sequence generator 320, a correlator 330, a selector 340 
and a error con-ection coding decoder 350. 

[0079] The. wavelet transformer 310 receives the watermarked image 125 and, in known manner, outputs a water- 
marked wavelet X'I. The correlator 330 receives a pseudo-random sequence 325 from the pseudo-random sequence 
generator 320, the watermarked wavelet 315 from the wavelet transformer 31 0 and outputs a watermark image bit cor- 
relation sequence 335. The watermarked image bit con-elation sequence is determined in the following way. Each bit of 
the pseudo-random sequence 325 is coded as follows, a "1 ' bit is coded as a "1 " and a "0" bit is coded as a "-1 ". The 
correlation value of each pixel of the selected portion of the watemiarked wavelet 315 is calculated using the following 
equation: 



#=1 



35 The watermarked Image bit con-elation sequence 335 is received by the selector 340 which outputs an uncorrected • 
UMID 345. The selector 340 outputs a "1 " for a watermarked image bit correlation value greater than 0 and a bit value 
"0^ for a image bit correlation value less than or equal to 0. The error correction code decoder 350 receives the uncor- 
rected UMID 345 and in known manner outputs a restored UMID 175. 

[0080] Figure 12, shows a system 130 for removal of the watermark for the watermarked image. The removal sys- 
40 tern 130 receives the restored UMID 175, the watermarked image 125 and outputs a restored image 135 from which 
the watermark is removed. The system 130 comprises a pseudo-random sequence generator 420 for generating a 
pseudo-randorn sequence 425, a spread spectrum signal generator 430 for receiving a restored UMID 145 and the 
pseudo-random sequence 425 and for producing a restored watermark 435. The system 130 further comprises: a 
wavelet transformer 41 0 for receiving a watermarked image 125 and outputting watermarked wavelet coefficients X'i; a 
45 watemiark subtracter 440 whfch receives the bits Wi of the restored watermark 435, the watermarked wavelet coeffi- 
cients X'I; and a strength a. The substractor outputs restored vv^velet coefficients Xi to an inverse wavelet transformer 
450. The inverse wavelet transfonner 450 outputs the restored image 135. 

[0081] The watermark subtracter 440 codes a bit "1 " of the restored watermark 435 as a "1 and a bit "0" as a "-I". 
The watermark subtracter 440 applies the folbwing equation: = x\ - a„lV,-. 

50 

Metadata- Figure 6 

[0082] The following is provided, by way of example, to illustrate the possible types of metadata generated during 
the production of a programme, and one possible organisational approach to structuring that metadata. 
[0083] Figure 6 illustrates an example structure for organising metadata. A number of tables each comprising a 
number of fields containing metadata are provided. The tables may be associated with each other by way of common 
fields within the respective tables, thereby providing a relational structure. Also, the structure may comprise a number 
of instances of the same table to represent multiple instances of the object that the table may represent. The fields may 
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be formatted in a predetermined manner. The size of the fields may also be predetermined. Example sizes include "Inf 
which represents 2 bytes, "Long inf which represents 4 bytes and "Double" which represents 8 bytes. Alternatively, the 
size of the fields may be defined with reference to the number of characters to be held within the field such as, for exam- 
ple. 8, 10, 16, 32, 128. and 255 characters. 
5 [0084] Turning to the structure in more detail, there is provided a Programme Table. The Programme Table com- 
prises a number of fields including Programme ID (PID), Title, Working Title, Genre ID, Synopsis, Aspect Ratio, Director 
ID and Picturestamp. Associated with the Programme Table is a Genre Table, a Keywords Table, a Script Table, a Peo- 
ple Table, a Schedule Table and a plurality of Media Object Tables. 

[0085] The Genre Table comprises a number of fields including Genre ID, which is associated with the Genre ID 
10 field of the Programme Table, and Genre Description. 

[0086] The Keywords Table comprises a number of fields Including Programme ID, which Is associated with the 
Programme ID field of the Programme Table, Keyword ID and Keyword. 

[0087] The Script Table comprises a number of fields including Script ID, Script Name, Script Type, Document For- 
mat, Path, Creation Date, Original Author, Version, Last Modified, Modified By, PID associated with Programme ID and 
15 Notes. The People Table comprises a number of fields including Image. 

[0088] The People Table is associated with a number of Individual Tables and a number of Group Tables. Each Indi- 
vidual Table comprises a number of fields including Image. Each Group Table comprises a number of fields including 
Image. Each Individual Table is associated with either a Production Staff Table or a Cast Table. 

[0089] The Production Staff Table comprises a number of fields Including Production Staff ID, Surname, Rrstname, 
20 Contract ID. Agent. Agency ID. E-mail. Address, Phone Number, Role ID. Notes, Allergies, DOB, National Insurance 
Number and Bank ID and Picture Stamp. 

[0090] The Cast Table comprises a number of fields including Cast ID, Surname, Rrstname, Character Name. Con- 
tract ID. Agent, Agency ID, Equity Numlier, E-mail, Address. Phone Number, DOB (date of birth) and Bank ID and Pic- 
ture-Stamp. Associated with the Production Staff Table and Cast Table are a Bank Details Table and an Agency Table. 
25 [0091] The Bank Details Table comprises a number of fields including Bank ID, which is associated with the Bank 
ID field of the Production Staff Table and the Bank ID field of the Cast Table, Sort Code, Account Number and Account 
Name. - 

[0092] The Agency Table comprises a number of fields including Agency ID, which is associated with the Agency 
ID field of the Production Staff Table and the Agency ID field of the Cast Table, Name. Address, Phone Number. Web 
30 Site and E-mail and a Picture Stamp, Also associated with the Production Staff Table is a Role Table. 

[0093] The Role Table comprises a number of fields including Role ID, which is associated with the Role ID field of 
the Production Staff Table, Function and Notes and a Picture Stamp. Each Group Table is associated with an Organi- 
sation Table. 

[0094] The Organisation Table comprises a number fields including Organisation ID, Name, Type, Address, Con- 

35 tract ID. Contact Name, Contact Phone Number and Web Site and a Picture Stamp. 

[0095] Each Media Object Table comprises a number of fields including Media Object ID, Name, Description, Pic- 
turestamp, PID, Format, schedule ID, script ID and Master ID. Associated with each Media Object Table is the People 
Table, a Master Table, a Schedule Table, a Storyboard Table, a script table and a number of Shot Tables. 
[0096] The Master Table comprises a number of fields including Master ID, which is associated with the Master ID 

40 field of the Media Object Table, Title, Basic UMID, EDL ID, Tape ID and Duration and a Picture Stamp. 

[0097] The Schedule Table comprises a number of fields including Schedule ID, Schedule Name, Document For- 
mat, Path, Creation Date, Original Author, Start Date, End Date, Version, Last Modified, Modified By and Notes and PID 
which is associated with the programme ID, 

[0098] The contract table contains: a contract ID which is associated with the contract ID of the Production staff, 
45 cast, and organisation tables; commencement date, rate, job title, expiry date and details. 

[0099] The Storyboard Table comprises a number of fields including Storyboard ID, which is associated with the 
Storyboard ID of the shot Table, Description, Author, Path and Media ID. 

[0100] Each Shot Table comprises a number of fields including Shot ID. PID, Media ID, Title, Location ID, Notes, 
Picturestamp, script ID, schedule ID, and description. Associated with each Shot Table is the People Table, the Sched- 
50 ule Table, script table, a Location Table and a number of Take Tables. 

[0101] The Location Table comprises a number of fields including Location I D. whteh is associated with the Location 
ID field of the Shot Table. GPS. Address, Description, Name, Cost Per Hour, Directions, Contact Name, Contact 
Address and Contact Phone Number and a Picture Stamp. 

[0102] Each Take Table comprises a number of fields including Basic UMID, Take Number, Shot ID, Media ID, Time- 
55 code IN, Timecode OUT, Sign Metadata, Tape ID, Camera ID, Head Hours, Videographer, IN Stamp, OUT Stamp. Lens 
ID, AUTOID ingest ID and Notes. Associated with each Take Table Is a Tape Table, a Task Table, a Camera Table, a lens 
table, an ingest table and a number of Take Annotation Tables. 

[0103] The Ingest table contains an Ingest ID which is associated with the Ingest Id in the take table and a descrip- 
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tion. 

[0104] The Tape Table comprises a number of fields including Tape ID, which is associated with the Tape ID field of 
the Take Table. PID, Format. Max Duration, Rrst Usage. Max Erasures, Current Erasure, ETA ( estimated time of anival) 
and Last Erasure Date and a Picture Stamp. 

[0105] The Task Table comprises a number of fields including Task ID, PID, Media ID. Shot ID, which are associated 
with the Media ID and Shot ID fields respectively of the Take Table, Title, Task Notes, Distribution List and CC List. Asso- 
ciated with the Task Table is a Planned Shot Table. 

[0106] The Planned Shot Table comprises a number of fields Including Planned Shot ID. PID, Media ID. Shot ID, 
which are associated with the PID, Media ID and Shot ID respectively of the Task Table. Director. Shot Title, Location.' 
Notes, Description. Videographer. Due date. Programme title, media title Aspect Ratio and Format. 
[O107] The Camera Table comprises a number of fields Including Camera ID. which Is associated with the Camera 
ID field of the Take Table, Manufacturer. Model, Format, Serial Number, Head Hours, Lens ID, Notes, Contact Name, 
Contact Address and Contact Phone Number and a Picture Stamp. 

[0108] The Lens Table comprises a number of fields including Lens ID, which is associated with the Lens ID field of 
the Take Table. Manufacturer. Model, Serial Number. Contact Name, Contact Address and Contact Phone Number and 
a Picture Stamp. 

[O109] Each Take Annotation Table comprises a number of fields including Take Annotation ID, Basic UMID, Ttme- 
code, Shutter Speed, Iris. Zoom. Gamma. Shot Marker ID, Filter Wheel, Detail and Gain. Associated with each Take 
Annotation Table is a Shot Marker Table. 

[0110] The Shot Marker Table comprises a number of fields including Shot Marker ID, which is associated with the 
Shot Marker ID of the Take Annotation Table, and Description. 

Insertion into LTC -Haures 7 to 9 

[0111] Refemng to Figure 7. a tape fonnat is shown schematically. Video and audio information is recorded in hel- 
ical tracks of which a set of, e.g. 10 or12, tracks records one field of video. The helical tracks include vertical interval 
time codes (VITC). The time codes may be duplicated in a linear time code track LTC, but the contents of the VITC and 
LTC may be different. The tape may comprise at least one other linear track (not shown). In this Illustrative description 
it is assumed that all video, audio and other infbrmatfon is recorded digitally. However, the video and audio may be 
recorded as analogue information. The video and audio Infomiation may be compressed according to the MPEG 2 
standard for example. 

[0112] The time codes are recorded once per video field. As schematfcally shown in Rgure 8, a known time code 
has 80 bits of which 16 are reserved for synchronisation information. 32 for time code bits and 32 for user defined bits, 
herein refen-ed to as "user bits". The user bits are interieaved with the other bits in a typical time code; however the 
invention is not limited to that. 

[01 13] The code, the UMID, is reconded in the user bits of the linear time code. If it has 64 bits it occupies two time 
codes. It thus refers to one frame of two video fields. In preferred embodiments the same code Is repeated every frame. 
Preferably the tape Is "prestriped" before use to record linear time codes for the fields. 

[0114] Refemng to Figure 9, a UMID generator 701 generates a UMID and a material source 703 provides in this 
example video material. The UMID and video material are fed to a watermark generator 705 which inserts the UMID as 
a watermark into the video. The watermarked video and the UMID from the generator are fed to a VTR 714 to record 
the UMID in the LTC and to record the watermarked video in the video tracks. 

Variants 

[0115] Instead of using a UMID, which is universally unique, another material identifier could be used. For example, 
for material originally recorded on a record medium, the identifier could be a serial number of a series thereof which 
identify the media of an organisation, plus IN and OUT time codes of material on the medium. That data could then be 
linked to for example a UMID in a datat^ase. Other material identifiers could be used. 

[01 1 6] Whilst the foregoing description, by way of example, illustrates the invention by reference to video material, 
the invention may be applied to any one or more of video material, audio material and data material. 

Claims 

1 - A method of identifying material comprising the step of inserting an identifying code into a material as a watermark, 
whteh code directly or indirectly identifies the material 

2. A method according to claim 1 , wherein metadata relating to the material is stored in a database and the identifying 



11 



EP 1 098 522 A1 

code links the material to the metadata In the database. 

3. A method according to daim 1, 2 or 3. wherein the identifying code also Identifies the owner of the material. 

5 4. A method according to claim 1. 2. 3 or 4, wherein the identifying code Indirectly identifies the material. 

5. A method according to daim 4, wherein the material is recorded on a recording medium and the identifying code 
identifies the example of the medium on which the material is recorded. 

10 6- A method according to anyone of daims 1 to 3, wherein the Identifying code directly Identifies the material. 

7. A method according to claim 6. wherein the Identifying code uniquely identifies the material. 

8. A method according to claim 7, wherein the identifying code is a UMID. 

IS 

9. A method according to claim 8, wherein the instance number field of the UMID is used to contain a fingerprinting 
code. 

1 0. A method according to claim any one of claims 1 to 9, wherein the Identifying code indudes data identifying author- 
20 ised users of the material. 

11. A method according to claim 10 when dependent on claim 8, wherein the data identifying authorised users is 
included in the instance number field of the UMID. 

25 1 2. A method acconding to claim 1 0 or 11 . wherein the said data identifying authorised users is generated by a random 
number generator. 

1 3. A method according to claim 1 0 or 11, wherein the said data identifying authorised users is generated by an author- 
ised user registry. 

30 

1 4. A method according to any preceding claim, wherein the material is any one or more of video material, audio mate- 
rial, and data material. 

15. A method according to claim 14, wherein the material comprises frames and the identifying code is in every frame 
35 Of the material. 

16. A method according to daim 14 or 1 5, wherein the identifying code includes a time code. 

17. A method according to any preceding claim, wherein the identifying code is additionally associated with the mate- 
40 rial other than as a watermark in the material. 

18. A method according to claim 17, wherein the material is video material and the identifying code is additionally in 
user bits of linear and/or vertteal Interval time codes. 

45 19. Apparatus comprising a code generator for generating a code directly or indirectly identifying material, and a water- 
mark generator for Inserting the code into the material as a watermark. 

20. Apparatus according to claim 19. comprising a database processor storing metadata relating to the material, and 
a communication link for linking the to the database processor, the Identifying code linking the material to the mista- 

50 data in the database. . 

21 . Apparatus according to daim 19 or 20, wherein the identifying code also identifies the owner of the material. 

22. Apparatus according to daim 19, 20 or 21, wherein the identifying code indirectly identifies the material. 

55 

23. Apparatus according to claim 22, comprising a recorder for recording the material on a recording medium, and 
wherein the identifying code identifies the example of the medium on which the material is recorded. 
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24. Apparatus according to anyone of claims 19 to 22, wherein the identifying code directly identifies the material. 

25. Apparatus according to claim 24, wherein the identifying code uniquely identifies the material. 

26. Apparatus according to claim 25, wherein the Identifying code is a UMID. 

27. Apparatus according to claim 26. wherein the instance number field of the UMID is used to contain a fingerprinting 
code. 

28. Apparatus according to any one of claims 19 to 26, wherein the identifying code Includes data Identifying author- 
ised users of the material. 

29. Apfraratus according to dalm 28 when dependent on daim 26, wherein the data identifying authorised users is 
included in the instance number field of the UMID. 

30. Apparatus according to claim 28 or 29, comprising a random number generator for generating the said data iden- 
tifying authorised users. 

31 . Apparatus, according to daim 28 or 29, comprising an authorised user registry for generating the said data identi- 
fying authorised users. 

32. Apparatus according to any one of claims 19 to 31 , wherein the material is any one or more of video material, audio 
material and data material. 

33. Apparatus according to claim 32, wherein the material comprises frames and the generator is arranged to insert 
the identifying code into every frame of the material. 

34. Apparatus according to daim 32 or 33, wherein the identifying code includes a time code. 

35. Apparatus according to any preceding claim comprising means for additionally associating the Identifying code with 
the material other than as a watermark in the material. 

36. Apparatus according to claim 35, wherein the material is video material and comprising means for inserting the 
identifying code in user bits of linear and/or vertical interval time codes. 

37. Apparatus according to anyone of daims 1 9 to 36, wherein the watermark generator is a frequency domain water- 
mark generator. 

38. Apparatus according to anyone of claims 19 to 36, wherein the watermark generator is a time domain watermari^ 
generator. 

39. Apparatus or method according to any preceding claim, wherein the watermark is robust 

40. Apparatus or method according to any preceding claim, wherein the watermark is reversible. 
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